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Abstract — This paper introduces a redundancy adaptation 
algorithm for an on-the-fly erasure networlt coding scheme 
called Tetrys in the context of real-time video transmission. 
The algorithm exploits the relationship between the redundancy 
ratio used by Tetrys and the gain or loss in encoding bit rate 
from changing a video quality parameter called the Quantization 
Parameter (QP). Our evaluations show that with equal or 
less bandwidth occupation, the video protected by Tetrys with 
redundancy adaptation algorithm obtains a PSNR gain up to or 
more 4 dB compared to the video without Tetrys protection. We 
demonstrate that the Tetrys redundancy adaptation algorithm 
performs well with the variations of both loss pattern and delay 
induced by the networks. We also show that Tetrys with the 
redundancy adaptation algorithm outperforms FEC with and 
without redundancy adaptation. 

I. Introduction 

Video traffic currently plays an important role on the Inter- 
net. The delivery of multimedia content has been intensively 
researched to provide better service and quality to end users. 
H.264/AVC (Advanced Video Coding), video coding standard- 
ized since 2003, has shown better compression performance 
than previous standard codecs such as MPEG-4 Part 2, H.263 
HI. Additionally, the newly standardized video codec. High 
Efficiency Video Coding (HEVC) lE) provides up to 50% 
bit rate savings for equivalent perceptual quality compared 
to H.264/AVC. However, the higher compression efficiency 
makes the encoded video more sensitive to errors and losses 
during transmission on networks. A small number of losses 
can significantly degrade the video quality perceived by end 
users. Thus, the challenge in real-time video transmission over 
error prone networks is twofold: 

1) Video traffic must be protected from losses over the 
Internet. Indeed, Wenger [3] showed that the Peak Signal 
to Noise Ratio (PSNR) decreases up to several dB when 
the loss rate is greater than 1%. From the video perspec- 
tive, error resilience tools ||3], H (e.g., data partition. 
Flexible Macroblock Ordering) provided by the video 
codec standards are designed to mitigate the impact of 
packet loss. However, these tools usually use extra bit 
rate which leads to lower coding efficiency ||5]- From 
the network perspective, the obvious way to provide 
reliability is retransmission. Nevertheless, the delay to 
recover the lost packets requires at least one additional 
Round Trip Time (RTT) which is not applicable for 
interactive applications. The traditional approach is to 
use Forward Error Correction (FEC) [0 to protect the 
video from losses. The main problem of this block 



code scheme is that it requires dynamically adapting 
its initial parameters and as a result, complex probing 
and network feedback analysis. Recently, novel erasure 
network coding approaches that prevent such complex 
configuration have been proposed Q, ||8l, ||9]- The main 
difference between these proposals is that the code in |]8], 
191 . called Tetrys, is more suitable for real-time video 
applications as this code is systematic and the repair 
packets in lO, lH are equally distributed between data 
packets. 
2) The network condition (e.g., delay, loss rate) varies over 
the time. Hence, it requires an adaptive mechanism for 
erasure codes to adapt to network dynamics. In llTOl . the 
authors propose a Random Early Detection FEC mecha- 
nism in the context of video transmission over wireless 
networks. This mechanism adds more redundancy packets 
if the queue at the Access Point is less occupied and 
vice versa. However, this approach assumes that the wired 
segment of the network is loss free. In reality, the wired 
segment of the network might experience packet losses 
due to cross traffic or network congestion. The approach 
in IfTTI switches between different FEC techniques to 
adapt to the state of the network in the context of multi- 
source streaming. 

Sahai in lfT2l showed the more the redundancy introduced 
on the network the shorter the packet recovery delay. Tetrys 
exhibits the same behavior for the stationary channel |l9l. 
However, when the channel state varies over the time, it is 
more difficult to control the variations of the redundancy ratio. 
Thus, in this article, we propose a redundancy adaptation 
algorithm for Tetrys to cope with network dynamics (e.g., loss 
rate and delay variations) in the context of real-time video 
transmission. Our algorithm adapts the Tetrys redundancy 
ratio by increasing or decreasing the video quality in order 
to deliver video in which the residual packet loss rate is 
minimized as much as possible within the delay constraint 
required by the application. Indeed, the algorithm exploits 
the relationship between the gain or loss in the encoding 
video bit rate by changing the video quality parameter, the 
Quantization Parameter, and the redundancy ratio used by 
Tetrys. From experiments with both x264 [[T3l and JM llT4l 
video encoders, we observe that each time the QP varies 
by one, the gain (or loss) in terms of encoding bit rate 
ranges from 10% to 20% while the video quality PSNR 
decreases (or increases) in range from 0.5 to 1 dB. The slightly 



degraded video up to 2 dB caused by the QP increase does not 
significantly interfere with the visual impact experienced by 
end users while the degraded video caused by unrecovered 
lost packets or late-arrival packets has a significant visual 
impact. Furthermore, we chose the Tetrys redundancy ratio 
list so that the video with slightly lower quality protected by 
Tetrys does not send more bit rate than the video with higher 
quality but without protection from the erasure codes. The 
results show that Tetrys with redundancy adaptation algorithm 
gains on average up to or more than 1 dB compared to Tetrys 
without redundancy adaptation algorithm and more than 4 dB 
compared to the video without protection. It is noted that 
the subjective evaluation from watching the resulting videos 
shows much better perceived quality obtained by Tetrys with 
redundancy adaptation algorithm compared to Tetrys without 
redundancy adaptation algorithm ifTSl . The simulation results 
show that the algorithm adapts well to both loss pattern and 
delay induced by networks. We also show that Tetrys with 
redundancy adaptation algorithm outperforms FEC with and 
without redundancy adaptation algorithm. 

The rest of this article is organized as follows; Section 
Hr briefly introduces the principle of Tetrys and notes some 
important properties. The redundancy adaptation with Tetrys 
is described in detail in Section |III1 Section |IV] presents the 
rationale behind a chosen redundancy list for H.264/AVC real- 
time transmission. Section |V] studies the impacts of algorithm 
parameters using Constant Bit Rate traffic. The evaluation 
with video traffic is presented in Section |VT] Tetrys compared 
with FEC is the topic of Section IVIII Section IVIIII discusses 
the differences between our approach and existing work. 
Concluding remarks are given in |IX] 

II. Tetrys overview 

Tetrys ID is an erasure network coding scheme that uses 
an elastic encoding window buffer Bew- This buffer stores 
all source packets sent and not yet acknowledged. For every 
k source packets, Tetrys sender sends a repair packet R[i..j) 
which is built as a linear combination of all packets currently 
in Bew from packets indexed / to j 
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finite field F^. Through this coding, the redundancy ratio is 
specified as l/(fc + 1) or 1/n (where n ~ fc + 1) which 
is equivalent to the code rate k/{k + 1). Unlike TCP that 
acknowledges every received packet, Tetrys receiver is only 
expected to periodically acknowledge the received or source 
decoded packets. Upon reception of acknowledgment packet, 
Tetrys sender removes the acknowledged source packets out of 
its Bew- Generally, Tetrys receiver can decode all lost packets 
as soon as the number of received repair packets is equal to 
the number of lost packets. By this principle, Tetrys is tolerant 
to burstiness losses in both source, repair and acknowledgment 
packets as long as the redundancy ratio exceeds the packet loss 



rate (PER). Furthermore, the lost packets are recovered within 
a delay that does not depend on the Round Trip Time (RTT). 
This property is very important for real-time applications 
where the time constraint is stringent. 

Figure [T] shows a simple Tetrys data exchange with fc = 2 
which implies that a repair packet is sent for every two sent 
source packets (equivalent to a redundancy ratio of 33.3%). 
The packet P2 is lost during the data exchange. However, the 
reception of repair packet ^(1.2) allows the reconstruction of 
P2. When the acknowledgment event occurs, Tetrys receiver 
sends a Tetrys acknowledgment packet that acknowledges 
packets Pi and P2- However, if this acknowledgment packet 
is lost, this loss does not interrupt the transmission; the sender 
simply continues to compute the repair packets from Pi . Eater, 
the lost packets P3, P4 are reconstructed thanks to P(i..6) and 
P(i..8). It must be noted that the reception of packet R(i..q) 
does not allow the recovery of the first lost packet observed 
(packet P3) since last packet recovery event (the reception 
of packet P(i_2))- Indeed, the packet P4 is still missing from 
the linear combination in packet P(i..6)- The reception of a 
second acknowledgment packet allows the sender to remove 
the acknowledged source packets and build the repair packets 
from Pg. The reader is referred to ||9] for further details. 

This example deserves two important remarks. First, all lost 
packets (the first lost packet since the last packet recovery 
event as well as the last lost packet observed) are recovered 
altogether Indeed, the Tetrys receiver has to wait until the 
number of repair packets is equal to the number of lost 
packets. Second, a higher redundancy ratio for the Tetrys 
sender leads to less delay recovery time for lost packets since 
the inter-arrival time between two consecutive repair packets 
is shortened. 
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Fig. 1. A simple data exchange with Tetrys (fc = 2) (9) 



III. Redundancy adaptation algorithm for 

REAL-TIME VIDEO TRANSMISSION 

This section first introduces our previous work which in- 
vestigated the model on packet recovery delay. Then, we 
present a redundancy adaptation algorithm for real-time video 
transmission which adapts to network dynamics based on 
insights from previous work. 

A. Previous work 

In ||9l, Tournoux et al. proposed a heuristic model 
^{t){d.p.b,T,R) (see the notations in Table |I]) for multimedia 
applications that requires an arrival of a certain amount of 
packets within a tolerable delay constraint D,nax- This model 
gives the cumulative distribution function of lost packets 
recovery delay. The model assumes a Constant Bit Rate (CBR) 
with the same packet size that produces a data packet every 
T seconds based on a network state (e.g., a delay d, a packet 
loss rate p and a burstiness of losses b). The authors found 



that e{t) 



{d.p,b,T,R) 



fits well to the WeibuU distribution which 



is defined by the scale A and the shape k parameters as follows: 

F[X < x] = 1 - e"*"^/^'" (1) 

where A(Aj^) is inversely proportional to Ar and is expressed 
as X{Ar) = A^%"- While K(A/f) evolves linearly as a 
function of Aji and is expressed as k{Aj^) ~ a^* A/j+6k- The 
coefficients at, hi (i € {X, k]) are related to the loss pattern 
{p and b) and n. However, this heuristic model has some 
drawbacks. First, it requires an accurate channel estimation 
which is not an obvious task. Furthermore, this model does 
not adapt well to network changes where both the loss rate, 
the burstiness of losses and propagation delay vary over time. 
However, this model does give us some insight designing a 
redundancy adaptation algorithm presented in section IIII-BI 

B. Redundancy adaptation algorithm 

The Tetrys redundancy adaptation algorithm aims to mini- 
mize the impact of packet losses in the context of real-time 
video transmission. Indeed, the algorithm seeks to answer the 
two following questions: 1) Which criteria are necessary to 
increase redundancy? 2) Which criteria are used to decrease 
redundancy?. Before answering these questions, we give an 
overall view of the Tetrys redundancy adaptation framework 
shown in Fig. |2] for real-time video transmission. The video 
encoder encodes the live source video based on the qual- 
ity/redundancy controller Tetrys encoder takes the encoded 
video and creates linear combinations for the repair packets 
according to the current redundancy ratio. The Tetrys receiver 
tries to decode the lost packets and pass the recovered lost 
packets to the video decoder as soon as possible. The moni- 
toring agent observes the loss pattern and delay induced by the 
network. The Tetrys redundancy adaptation module gathers the 
information from the monitoring agent and sends increasing 
redundancy feedback, decreasing redundancy feedback or does 
nothing according to the algorithm presented below. Once the 
sender receives the feedback information, it changes both the 
redundancy ratio and video quality accordingly. 



k 


The number of sent source packets between two con- 
secutive repair packets 


n 


The total number of source packets plus a repair packet 

n = fc + 1 


R 


Redundancy ratio R — j^ 


P 


Packet loss rate 


b 


Average length of consecutive lost packets (mean burst 
size) 


Afl 


The difference between redundancy ratio and packet 
loss rate A^ = _R— p=i— p 


d 


The propagation delay 


J-^max 


The maximum tolerable delay required by the applica- 
tion 


T 


The mean interval time between two consecutive source 
packets 


I 


The mean interval time between two consecutive repair 
packets 


y 


The number of lost packets needed to be recovered in 
the receiver buffer 


z 


The number of repair packets received at the receiver 


Z 


The number of additional repair packets needed to 
recover all losses Z — y — z 


Pr 


The first lost packet which has not been recovered yet 
since last packet recovei-y event 


u 


The remaining time to recover the first lost packet (as 
well as all lost packets) before the deadline Dmax 



TABLE I 
Notations 



1) Which criteria are necessary to increase redundancy?: 
In section [III we noted that the first lost packet (as well as 
all lost packets) can be recovered when Z = 0. This means 
that the number of received repair packets is equal to the 
number of lost packets. When the Tetrys receiver observes 
some lost packets that have not been recovered yet (or Z > 0), 
it estimates the arrival time of the first lost packet Pi in 
the absence of losses based on T and the arrival time of 
the successfully received previous packet Pi-i. The Tetrys 
receiver then deduces the remaining time ti to recover packet 
Pi as well as all lost packets before the deadline Dmax 
from the estimated arrival time of the packet Pi and Dmax- 
In an ideal case where there are no further losses for both 
data and repair packets, the Tetrys receiver needs Z * I 
(in time) to recover all losses. The condition Z * I < ti 
implies that all losses can be recovered before the application 
constraint D,nax while Z * I > ti implies that some lost 
packets cannot be recovered before the application deadline. 
However, the algorithm actually needs Y > Z to recover all 
losses, since losses may still occur up until the time when the 
receiver receives enough Tetrys repair packets. Y depends on 
the loss distribution (e.g., Bernoulli or Gilbert-Elliott |[T6l ). 
In ||9l, Tournoux et al. theoretically calculate the decoding 
delay knowing Z for the case of Bernoulli where the losses 
are uniformly distributed. However, this implementation is 
far from being trivial. Furthermore, there are no theoretical 
estimations of the decoding delay for other loss patterns (e.g. 
Gilbert-Elliott). Thus, we propose building an algorithm that 
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Fig. 2. Tetrys redundancy adaptation framework 



increases the redundancy ratio if one of the two following 
conditions is not satisfied; 

1) Z*I* f <U 

2) P[X < U] > minth 

where / > 1 is a coefficient that indicates the proactive level of 
the algorithm. The greater f means that the algorithm is more 
proactive to react to packet losses by adapting quickly to the 
redundancy before passing the application delay constraint and 
vice versa. The first condition implies a reactive behavior that 
the receiver actually observes at a given time, while the second 
condition indicates an estimation behavior that might occur in 
the future. In fact, given i;, p and b observed at the receiver, 
the algorithm increases the redundancy if the probability from 
the WeibuU function in equation ([T]i to recover the lost packets 
before ti is lower than a certain threshold minth (e-g-, 0.9) 
which is required for the applications. When one of the 
two conditions is not satisfied the Tetrys receiver sends a 
feedback message to the Tetrys sender to require a redundancy 
increment. 

2) Which criteria are used to decrease redundancy?: The 
Tetrys receiver sends a feedback message that requires a 
redundancy decrement if both of the following conditions are 
satisfied: 

1) Z = 

2) P[X < Dmax] > maxth 

The first condition means that at a given time, there are 
no unrecovered packets. The second condition indicates that 
with the current redundancy ratio and the observed network 
state, the probabiUty from the WeibuU function of recovering 
packet losses before the application deadline D^ax is greater 
than a certain threshold maxth (e-g-, 0.99). Thus, these two 
conditions allow the safe reduction of redundancy for better 
video quality. It is clear that a given maxth must be greater 
than minth- The impact of the difference between minth and 
maxth is studied in Section IV-AI 

C. Feedback information in Tetrys acknowledgment 

According to the algorithm, the Tetrys receiver sends a feed- 
back message each time it requires a redundancy increment 
or decrement. These feedback messages might be lost during 
transmission. The loss of feedback messages that requires a 
redundancy decrement does not have much impact on the 



residual loss rate since the Tetrys sender uses a much higher 
redundancy ratio than the current loss rate. However, the loss 
of feedback messages that requires a redundancy increment 
has a stronger impact on the performance since the Tetrys 
receiver experiences the packet losses that might not be recov- 
ered before the application constraint. Furthermore, the losses 
may still persist or even become worse. This may lead to more 
lost packets that cannot be recovered before the application 
deadline. In a case where all increasing redundancy feedback 
messages are lost, the Tetrys redundancy adaptation algorithm 
has the same performance in terms of residual loss rate as 
Tetrys without the redundancy adaptation algorithm where 
the redundancy ratio is not changed regardless of network 
conditions. Thus, we propose a simple mechanism which is 
more robust to feedback losses. Indeed, in the event the Tetrys 
receiver decides to send a feedback message (redundancy 
increment or decrement), it sends a Tetrys acknowledgment 
packet in which the feedback information is included. This 
feedback information is also included in the periodic Tetrys 
acknowledgment packets afterwards until the Tetrys sender 
updates its redundancy ratio. Tetrys sender only updates its 
redundancy once when it first sees the update requirement. In 
this way, Tetrys does not need to handle a new packet type. 

IV. Redundancy list for H.264/AVC real-time 

TRANSMISSION 



The redundancy adaptation algorithm in Section IIII-BI does 
not specify the amount of redundancy adjustment. In general, 
the n parameter of Tetrys only takes integer values, the list of 
redundancy ratios is i? G {0.5, 0.33, 0.25, 0.2, 0.17, ...} which 
is equivalent to the list for n G {2, 3, 4, 5, 6, ...}. However, this 
general redundancy list may not fit well to video transmission 
where the video characteristics are taken into account. In video 
coding, the quantization parameter (QP) controls the trade- 
off between compression efficiency and image quaUty ifTTl . 
Indeed, the QP is inversely proportional to the image quality. 
Each time the value of QP is increased by one, the video 
quality is slightly degraded and vice versa. This degraded 
video quality comes from a lower encoding bit rate. The 
extra bit rate gained from lowering video quality can be 
used by the erasure codes to protect against packet losses. 
In order to estimate the variations of video bit rate due to the 



variations of the QP, we performed several tests with an x264 
ifTSl encoder using CIF video format. The reference video 
sequences are encoded with H.264/AVC BaseUne profile using 



QP = QPi = QPp 



QPb - 2 Ha. Fig. [3(5)] and 



|3(b)| show the encoding bit rate in kh/ s and the PSNR in dB 
as a function of QP for different reference video sequences. 
Fig. |3(c)| shows the encoding bit rate gain for the 'Foreman' 
sequence each time the QP is increased by one. For example, 
the value 20 in the x axis in Fig. |3(c)| implies that when the 
QP is increased from 20 to 21, the bit rate gain is 15.8% 
whereas the encoding bit rate decreases from 1357.2 kh/ s at 
QP ^ 20 to 1143.2 fc&/s at QP = 21. Similarly, Fig. [3(d)l 
shows the quality degradation in dB each time QP is increased 
by one. Similar observation on the gain in encoding bit rate 
and the loss in PSNR each time QP is increased by one 
is also obtained with the 'Akiyo', 'Container', 'News' and 
'Silent' sequences. An important remark deduced from Fig. 
[3] is that each time the value of QP is increased by one, the 
encoding bit rate gain is in the range of 10% to 20% while 
the video quality degradation is in the range of 0.5 to IdB. 
This percentage gain in bit rate can be used by the erasure 
codes to protect the video from losses. It should be noted 
that the impact of a slightly degraded video ranging from 0.5 
to 1 dB is negligible to the human eye. Similar results with 
different video encoders (e.g., JM lfT4l . x264), video profiles 
(e.g.. Baseline, High), video formats (e.g., QCIF, 4CIF, 720p), 
Group of Pictures (GOP) sizes and QP patterns can be found 
in ifTsl . Thus, we propose a redundancy list for the case 
of H.264/AVC video transmission R e {0.1,0.2,0.33,0.5} 
which is equivalent to the list for n G {10, 5, 3, 2}. The chosen 
list of redundancy ratios ensures that the lower quality video 
plus redundancy used by Tetrys does not send extra bit rate 
compared to the normal quality video without protection. This 
prevents the possibility of congestion caused by the extra bit 
rate injected on to the networks. Let us give an example by 
assuming that the Tetrys sender is transmitting a video with 
QP = 29 and a Tetrys redundancy ratio of 20%. If the 
Tetrys sender receives increasing redundancy feedback, the 
Tetrys sender increases its redundancy ratio to 33.3% while 
decreasing the video quality to QP = 30. If the Tetrys sender 
receives decreasing redundancy feedback, the Tetrys sender 
reduces its redundancy ratio to 10% while increasing the video 
quality to QP = 28. In a case where the Tetrys sender receives 
decreasing redundancy feedback while its redundancy is 10%, 
Tetrys sender maintains its redundancy ratio since 10% is the 
lowest value in its redundancy list and it is necessary to protect 
the video from packet losses. 

V. Evaluation the algorithm parameters with 

CBR TRAFFIC 

We evaluate the Tetrys redundancy adaptation algorithm 
using ns ~ 2 |fT9l . We send a Constant Bit Rate traffic at 
\%QQkb/s with a constant packet size of 500 6yies. The one- 
way propagation delay is set to 50?tis which results in a 
100 ms Round Trip Time (RTT) and the one way End-to-End 
delay constraint Dmax is set to 150 ms, based on ITU-T/G.144 
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Fig. 3. Different CIF video sequences encoded by x264 with Baseline profile 



I20il . This constraint is recommended for highly interactive 
applications. The packets recovered after this deadline are con- 
sidered as lost by the application. The Tetrys acknowledgment 
frequency is set to 10 ms. We evaluate the performance using 
an information loss rate (ILR) which indicates the residual 
loss rate after decoding within the application deadline at 
the end of each simulation. Tetrys shows best performance 
against uniform losses ID, ll2n . thus, we only evaluate the 
performance with the Gilbert-Elliott erasure channel which is 
specified by the average packet loss rate (PER) and the average 
length of consecutive lost packets (or mean burst size) |[T6l . 
In order to provide a fair comparison, the sender sends 50000 
data packets while the number of repair packets depends on 
the redundancy ratio used in each simulation. 

A. Impact of algorithm parameters 

We first evaluate the impact of coefficient / by disabling 
the second condition {P[X < ti] > m,inth) in the increasing 
redundancy criteria. The maxth is set to 0.99 in the decreasing 
redundancy criteria. Fig. |4(a)| shows a slight decreasing trend 
in ILR for different PLRs with mean burst size 6 = 3 when the 
coefficient increases. The decrease in ILR leads to an increase 
in the average redundancy ratio which is shown on the second 
y axis. The greater coefficient / implies a more proactive 
approach against packet losses and vice versa. It is notable 
that the ILR of PER = 5% is smaller than PER =1%. This 
can be explained by the amount of redundancy used by Tetrys 
in both simulations. In fact, at / = 3, Tetrys uses on average 
wl3% during the simulation at PER =1% while it uses on 
average Ri28% at PER=5%. Then, we evaluate the impact of 
mirith by disabling the first condition (Z * I * f < ti) in the 
increasing redundancy criteria. The maxth is still set to 0.99 
in the decreasing redundancy criteria. Fig |4(b)| shows that the 
greater value of m,inth results in a lower ILR. The remark 
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Fig. 4. Impact of the algorithm parameters. The lines with dots represent the Information Loss Rate and the dots represent the average redundancy ratio. 
The red (+), blue (x) and black (*) colors show the PLR at 1%, 5% and 10%, respectively. The channel has a mean burst size 6 = 3. 



for PLR=1% and PLR=5% at 6 = 3 is similar to the case 
of coefficient /. Furtiiermore, at PLR=5% and 6 = 3, the 
redundancy ratio of Tetrys is greater than or equal to 20% 
most of the time since the second condition in the increasing 
redundancy criteria is not satisfied if the redundancy ratio is 
10% compared to PLR=5% and b ^ 3. Finally, we evaluate 
the impact of maxth by fixing the coefficient f ~ 2 and the 
minth = 0.9. Fig. |4(c)| shows that the algorithm suffers a 
higher ILR if the maxth is low. Indeed, the lower value of 
maxth implies a closer gap between minth = 0.9 and maxth 
where the algorithm oscillates frequently its redundancy ratio. 
In fact, a redundancy ratio of 10% is not high enough 
to cover a PLR of 10%. Thus, the algorithm switches the 
redundancy ratio between 20% and 33.3% most of the time, 
while at PLR=5%, the algorithm switches the redundancy ratio 
between 10% and 20%. For instance, at maxth = 0.95, the 
redundancy ratio oscillates frequently since maxth is close 
to minth = 0.9. This explains why the ILR at PLR=5% is 
lower than the one at PLR=10% when maxth is low. Thus, we 
recommend using a reasonable value of minth that is required 
for applications and a high value of maxth (> 0.98). 

B. Impact of losses on feedback channel 

To evaluate the impact of losses on the feedback channel, 
we conducted the same simulations as in Section IV-AI with 
these settings; f — 2, minth = 0.9 and maxth = 0.99. 
We use a Bernoulli erasure channel for the feedback link. 
The loss pattern on the forwarding path is the same as 
previous simulations. From Fig. |5] we see that the ILR curve 
is rather flat against the increasing loss rate on the feedback 
channel. These simulations show that the algorithm is robust 
to the loss rate on the feedback channel by including the 
feedback information in the Tetrys acknowledgment packets 
as presented in Section UlI-CI 

VI. Evaluation with video traffic 

The one-way propagation delay, the one-way E2E delay 
constraint and the Tetrys acknowledgment frequency are set 
as in Section |V] The 'Foreman' CIF video sequence of 300 
frames is repeated 5 times to provide a video of 1500 frames 
at a rate of 30 frames per second. This results in 50 seconds 



of real-time video transmission. Thus, each 10 seconds of 
simulation represents a single 'Foreman' sequence. We encode 
the video using basic coding where there is no error resilience 
mechanism (e.g.. Flexible Macroblock Ordering, etc.) |l3], [JU. 
The packet size varies and depends on the encoded video. 
The video is encoded using the Baseline profile which is 
suitable for real-time video transmission. The loss concealment 
mechanism is frame copy. We set the coefficient / = 4, 
minth = 0.9 and maxth = 0.99. We evaluate the videos with 
three schemes: Tetrys with redundancy adaptation algorithm, 
Tetrys without redundancy adaptation algorithm and without 
Tetrys protection. The video without Tetrys protection is 
encoded with QP = 27 while the video with a fixed Tetrys 
redundancy ratio of 10% is encoded with QP = 28. The QP in 
the video protected by Tetrys with the redundancy adaptation 
algorithm varies according to the redundancy ratio in such a 
way that the bandwidth occupation does not exceed the video 
without Tetrys protection. We evaluate all three scenarios. In 
the first scenario, the loss rate is fixed while the mean burst 
size varies. Both loss rate and mean burst size vary in the 
second scenario. Finally, both loss rate and mean burst size 
are fixed while the RTT varies in the third scenario. 
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Fig. 5. Impact of losses on the feedback channel. The lines with dots 
represent the Information Loss Rate and the dots represent the average 
redundancy ratio. The red (+), blue (x) and black (*) colors show the PLR 
at 1%, 5% and 10%, respectively. The forward channel has a mean burst 
size 6 = 3. The loss rate and mean burst size on the forwarding channel is 
independent of the feedback channel 



A. Evaluation with fixed loss rate and variable mean burst 



TABLE II 

Loss PATTERN DURING 50S OF SIMULATION IN SECTIOn IVI-AI 



Size 



The loss pattern over 50 seconds of simulation is shown in 
Table nil Fig. |6(a)| shows the results between Tetrys with adap- 
tive redundancy and Tetrys without the redundancy adaptation 
algorithm. In the frame range from to 300, the PSNR of 
Tetrys with the redundancy adaptation algorithm is the same 
as that of Tetrys without the redundancy adaptation algorithm 
since there are no losses. The Tetrys with redundancy adap- 
tation algorithm maintains its minimum redundancy ratio of 
10%. In the frame range from 301 to 900 where the Gilbert- 
Elliott loss pattern with PLR=2% and b — 2 occurs, Tetrys 
without the redundancy adaptation algorithm observes a much 
more significant drop in quality than Tetrys with redundancy 
adaptation algorithm. In some frames, Tetrys with the re- 
dundancy adaptation algorithm has a slightly lower PSNR 
in the absence of video quality degradation. This is because 
Tetrys with the redundancy adaptation algorithm lowers the 
video quality by increasing the QP for more redundancy to 
adapt to network conditions. However, visually, this slightly 
lower quality cannot be clearly distinguished by the human 
eye. However, the end users suffer much stronger impact 
in each event where the PSNR significantly drops due to 
residual packet losses. In the frame range from 901 to 1500 
where the Bernoulli loss pattern with PLR=2% occurs, Tetrys 
without the redundancy adaptation algorithm performs well. It 
suffers only one quality degradation event while Tetrys with 
the redundancy adaptation algorithm does not experience any 
losses. Fig. |6(b)| shows the poor performance of the video 
without protection by Tetrys regardless of the loss pattern. 
Fig. |6(c)| shows the bandwidth usage at the outgoing interface 
of the sender, it can be seen that all three schemes use similar 
bandwidth on average. Table |III] shows that Tetrys with the 
redundancy adaptation algorithm objectively gains on average 
only 0.2 dB compared to Tetrys without the redundancy adap- 
tation algorithm; but subjective evaluation by watching the 
resulting videos iJlSj and Fig. |6(a)| shows a much better per- 
formance by Tetrys with the redundancy adaptation algorithm. 
Additionally, Tetrys with the redundancy adaptation algorithm 
and Tetrys without the redundancy adaptation algorithm both 
achieve the same PSNR in first 10 seconds of simulation 
since there are not any losses. This explains why the objective 
evaluation does not always adequately reflect the video quality 
experienced by the end users. It should be noted that the 
standard deviation of Tetrys with the redundancy adaptation 
algorithm which indicates a fluctuation in video quality is 
much lower than the one of Tetrys without the redundancy 
adaptation algorithm. Table [III] also shows that the video with 
Tetrys redundancy adaptation algorithm uses less bandwidth 
on average than the video without Tetrys protection. This 
confirms our conservative choice of redundancy ratio list in 
Section IIII-BI where the video with the Tetrys redundancy 
adaptation algorithm does not use more bandwidth than the 
video without protection. 



Time (s) 


Loss pattern 


Frame range 


0- 10 


no losses 


0- 300 


10- 30 


Gilbert-Elliott PLR=2%, 6 = 2 


301 - 900 


30 - 50 


Bemouilli PLR=2% 


901 - 1500 



TABLE III 
Mean and standard deviation of psnr and b andwi dth usage 

WITH different SCHEMES IN SECTIOn IVI-AI 





PSNR (dB) 


BW usage (kb/s) 


Tetiys with adaptive redundancy 


35.9 ± 2.3 


737.8 ± 140.3 


Tetiys without adaptive redundancy 


35.7 ± 3.3 


740.3 ± 148.7 


Without Tetrys 


31.1 ± 6.4 


774.1 ± 174.8 



B. Evaluation with both variable loss rate and mean burst size 

The loss pattern in this simulation is shown in Table |IV] 
Fig. |7(a)| shows that Tetrys without redundancy adaptation 
algorithm suffers from variations of both PLR and mean burst 
size. In fact, when the PLR is increased from 2% to 3% from 
frame 901, Tetrys without the redundancy adaptation algorithm 
experiences more residual losses than previous frames which 
leads to more video quality degradation events. Fig. [7(b)] con- 
firms that video without protection from erasure codes suffers 
poor performance from both PLR and mean burst size. The 
instantaneous bandwidth usage of Tetrys with the redundancy 
adaptation algorithm in Figure |7(c)| is slightly different from 
Fig. |6(c)| since its uses both different redundancy ratio and 
video quality to adapt to the network state. Table |V] shows 
that Tetrys with the redundancy adaptation algorithm objec- 
tively gains on average 1.2 dB compared to Tetrys without 
the redundancy adaptation algorithm. Furthermore, from the 
subjective evaluation perspective, Tetrys with the redundancy 
adaptation algorithm gives a much better performance llTSl . 
In this simulation, the video with the Tetrys redundancy 
adaptation algorithm uses the same average bandwidth as the 
video without Tetrys protection. 

TABLE IV 
Loss pattern during 50s of simulation in section IvI-BI 



Time (s) 


Loss pattern 


Frame range 


0- 10 


no losses 


- 300 


10-20 


Gilbert-Elliott PLR=2%, b = 


= 2 


301 - 600 


20 - 30 


Gilbert-Elliott PLR=2%, b = 


= 3 


601 - 900 


30-40 


Gilbert^EUiott PLR=3%, b = 


= 2 


901 - 1200 


40 - 50 


Gilbert-Elliott PLR=3%, b = 


= 3 


1201 - 1500 



TABLE V 
Mean and standard deviation of psnr and b andwi dth usage 

WITH different SCHEMES IN SECTIOn IVI-BI 





PSNR (dB) 


BW usage (kb/s) 


Tetrys with adaptive redundancy 


35.3 ± 2.6 


773.8.3 ± 138.1 


Tetrys without adaptive redundancy 


34.1 ± 5.0 


740.3 ± 148.7 


Without Tetrys 


31.9 ± 6.2 


774.1 ± 174.8 




(a) Tetrys with redundancy adaptation algoritlim 
vs Tetrys witliout redundancy adaptation algo- 
rithm 
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(a) Tetrys with redundancy adaptation algorithm 
vs Tetrys without redundancy adaptation algo- 
rithm 
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(b) Tetrys with redundancy adaptation algorithm 
vs without Tetrys protection 



(c) Instantaneous bandwidth usage of 3 schemes 



Fig. 6. Comparison between 3 schemes with fixed PLR and varied b 
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(b) Tetrys with redundancy adaptation algorithm 
vs without Tetrys protection 



(c) Instantaneous bandwidth usage of 3 schemes 



Fig. 7. Comparison between 3 schemes with varied both PLR and h 



C. Evaluation with varied RTT 

The loss pattern is fixed witii PLR=2% and 6 = 2 during 
the simulation. The one-way propagation delay is set to 50 ms 
at the beginning of the simulation and increases to 70 ms after 
20 seconds. Fig. |8] shows that both Tetrys with and without 
redundancy adaptation algorithm performs well at the one- 
way delay of 50 ms. However, when the delay is increased to 
70 TOs where the remaining time to recover the lost packets is 
shortened, Tetrys without the redundancy adaptation algorithm 
observes a greater drop in quality. However, the performance 
of Tetrys with the redundancy adaptation algorithm remains 
constant since the algorithm takes into account this change 
from the signal ti and reacts accordingly. 
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Tetrys with redundancy adaptation algorithm vs Tetrys without 



redundancy adaptation algorithm with varied RTT 



VII. Comparison with fec adaptation scheme 

While Tetrys adapts to network dynamics by changing only 
one parameter, the redundancy ratio, redundancy adaptation 
with FEC is more complicated. First, FEC(k,n) which indicates 
k source packets and n ~ k repair packets requires changing 
both the group size n and the redundancy ratio [n — k)/n. It 
is not evident to provide the largest group size possible before 
transmitting the data since FEC is more robust to burstiness 
losses at a larger group size. However, large group size may 
lead to inefficiency since FEC repair packets may arrive after 
the application delay constraint due to its group size or a longer 



delay caused by the network. Second, the criteria for adapting 
the FEC redundancy ratio and group size are not obvious. 
Tetrys has the signals from the first lost packet which has not 
been recovered yet and the probability of recovering the losses 
before the delay constraint. On the contrary, FEC must wait 
for the arrival of the last packet in a FEC group if it is unable 
to recover the lost packets with the current received packets. 
In order to provide some insights into how Tetrys with the 
redundancy adaptation algorithm performs compared to FEC, 
we propose a simple redundancy algorithm for FEC with the 
assumption that the best FEC group size n is known. The 



redundancy ratio list is the same as with Tetrys ([10, 20, 33.3, 
50]%). The algorithm decides to increase the redundancy if 
its current redundancy ratio is less than the observed loss 
rate plus a threshold minpEc mathematically presented by 
Rfec < p + minpEC- Similarly, the algorithm decreases the 
redundancy if Rfec > P + max pec- In this case, minpEC 
must be lower than maxpEC- 

We conducted several simulations to determine the largest 
FEC group size (i.e., the best FEC group size) that would 
not be inefficient. By varying the FEC group size in each 
simulation, we found that the largest FEC group size is 10 
packets. Thus, we set n at or close to 10 for the simulation 
and let k vary according to the redundancy ratio. For instance, 
if the redundancy ratios are 10% and 33.3%, we use FEC(9,10) 
and FEC(6,9), respectively. It can be noted that the FEC group 
size can be larger with higher quality or video resolution 
(e.g., 4CIF or 720p) where there are more packets per image 
encoded than the CIF 'Foreman' video. We used the loss 
pattern as in Table |IV] We varied minpEc from 0.06 to 0.2 
with a step size of 0.02 and maxpEc from 0.1 to 0.3 with a 
step size of 0.05 while satisfying the constraint minpEc < 
maxpEC- We chose the combination where maxpEc = 0.25 
and minpEc = 0.2 that provides the best performance. The 
performance evaluation is based on the number of decoded 
frames which have a PSNR greater than 30 dB. Fig. |9(a)| shows 
that at PLR=2% with both 6 = 2 and 6 = 3 where the video 
frame ranges between 301 and 900, FEC with the adaptive 
redundancy achieves similar performance to Tetrys with the 
adaptive redundancy. However, when the PLR is increased to 
3% from frame 901, we see that FEC suffers higher video 
quaUty degradation than Tetrys. Furthermore, from frame 1 201 
where the mean burst size is equal to 3, FEC suffers severe 
quality degradation due to residual losses. Since the FEC group 
size is small, FEC exhibits more problems at higher burst 
sizes. From the simulation, FEC with the adaptive redundancy 
uses an average redundancy ratio of 26.2%. To compare with 
traditional FEC, we also conduct a simulation with FEC(7,10) 
without adaptive redundancy which resulted in a redundancy 
ratio of 33.3%. Even though the redundancy ratio of 33.3% 
is favorable for FEC, Fig. |9(b)| shows that Tetrys sill provides 
better performances than FEC. Table |VT] shows that Tetrys 
achieves a better PSNR and uses less bandwidth than FEC 
with and without adaptive redundancy. 

Our objective is to show how the Tetrys redundancy adap- 
tation algorithm performs relative compared to FEC. In this 
article, we do not provide a best FEC redundancy adaptation 
algorithm compared to our Tetrys redundancy adaptation al- 
gorithm. In 191, JHI, with fixed redundancy ratio, we have 
shown that Tetrys outperforms FEC in both single path and 
multipath transmissions. As argued at the beginning of this 
Section, an adaptive redundancy scheme with FEC is more 
complicated and FEC does not have a strong enough signal to 
react to network dynamics. 
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(b) Tetrys with adaptive redundancy algorithm vs FEC 
with a fixed redundancy ratio of 33.3% 

Fig. 9. Tetrys vs FEC 



TABLE VI 
Mean and standard deviation of psnr and bandwidth usage 

WITH different SCHEMES IN SECTIOn TVTII 





PSNR (dB) 


BW usage (kb/s) 


Tetrys with adaptive redundancy 


35.3 ± 2.6 


773.8 ± 138.1 


FEC with adaptive redundancy 


35.0 ± 3.5 


889.3 ± 155.1 


FEC without adaptive redundancy 


34. 1 ± 4. 1 


896.5 ± 136.5 



VIII. Related work 

Our approach differs from the existing work in the following 
aspects. First, we use an on-the-fly and systematic erasure 
network coding scheme that shows better performances than 
FEC codes in terms of packet recovery rate in both single- 
path and multi-path transmissions ID, II2TI . Secondly, the 
Tetrys redundancy adaptation algorithm focuses on real-time 
video transmission with a stringent delay constraint required 
by applications such as video conferencing while the existing 
proposals target the context where the receiver has a large 
playout buffer IfTOl , Il22l . Lastly, our algorithm does not 
add extra bit rate by exploiting the relationship between 
the redundancy ratio and the varition of the Quantization 
Parameter ll23l . In ll24l . the authors propose a FEC redundancy 
adaptation algorithm inside the Encoded Multipath Streaming 
(EMS) scheme. This algorithm increases the redundancy ratio 
if the residual loss rate after decoding is greater than a certain 
threshold and vice versa. Our approach is to minimize the 
residual loss rate to increase the video quality experienced by 



end users. Furthermore, the redundancy adjustment in 11241 is 
not video-aware while our algorithm adjusts the redundancy 
ratio based on the changes in the Quantization Parameter 

IX. Conclusions and future work 

In this paper, we introduced a redundancy adaptation algo- 
rithm based on an on-the-fly erasure network coding scheme 
for real-time video transmission called Tetrys. By exploiting 
the relationship between the changes in the Quantization 
Parameter, the loss or gain in encoding bit rate and the 
Tetrys redundancy ratio, a video with the Tetrys redundancy 
adaptation algorithm achieves better video quality in terms 
of PSNR than both the video without the Tetrys redundancy 
adaptation algorithm and the video without Tetrys protection. 
We chose the redundancy ratio list so that the video with 
the Tetrys redundancy adaptation does not send more bit rate 
than the video without projection to prevent congestion. We 
have shown that the Tetrys redundancy adaptation algorithm 
performs well with the variations of both loss pattern and delay 
induced by networks. Finally, we also showed that Tetrys with 
the redundancy adaptation algorithm outperforms FEC with 
and without redundancy adaptation. 
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